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In a p-spin interaction spherical spin-glass model both the spins and the couplings are allowed 
to change in the course of time. The spins are coupled to a heat bath with temperature T, while 
the coupling constants are coupled to a bath having temperature Tj. In an adiabatic limit (where 
relaxation time of the couplings is much larger that of the spins) we construct a generalized two- 
temperature thermodynamics. It involves entropies of the spins and the coupling constants. The 
application for spin-glass systems leads to a standard replica theory with a non-vanishing number 
of replicas, n = T/Tj. For p > 2 there occur at low temperatures two different glassy phases, 
— i' depending on the value of n. The obtained first-order transitions have positive latent heat, and 

positive discontinuity of the total entropy. This is the essentially non-equilibrium effect. The 
predictions of longtime dynamics and infinite-time statics differ only for n < 1 and p > 2. For p = 2 
^ ' correlation of the disorder (leading to a non-zero n) removes the known marginal stability of the spin 

glass phase. If the observation time is very large there occurs no finite-temperature spin glass phase. 
In this case there are analogies with the broken-ergodicity dynamics in the usual spin-glass models 
and non-equilibrium (aging) dynamics. A generalized fluctuation-dissipation relation is derived. 



PACS: 64.70.Pf, 05.70.Ln, 75.10Nr, 75.40Cx, 75.50Lk 
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Q ' I. INTRODUCTION 

,_H \ The spin-glass model proposed by Edwards and Anderson |l],^j is a paradigm for large number of different random 

■ systems in nature. Its main assumptions, randomness and quenching of exchange couplings, reasonably reflect the 
crucial properties of random magnets with localized magnetic moments , structurally disordered materials |(| , and 
large number of other systems (for example, artificial neural networks Q|). In particular, alternation means that there 
are ferromagnetic as well as antiferromagnetic couplings (attractive and repulsive in the language of particle dynamics 
in structurally disordered compounds and alloys || ) , and quenching means that there exists a large difference between 

qv^ relaxation times of couplings and magnetic degree of freedom (spins). 

| The typical example of a spin-glass is a dilution of a magnetic metal (such as Fe or Mn) in a non-magnetic host 

■ (for example Cu), where the concentration of the magnetic metal is not very large. Thus there is no direct exchange 
interaction between magnetic ions, but due to conduction electrons of Cu an indirect exchange interaction is possible 
(RKKY interaction) ||. This interaction has oscillating character with respect of the distance between a pair of ions, 
and because the positions of magnetic ions in the dilute are random we have the typical case of spin-glass. By a more 
simple and evident mechanism spin-glass is realized in a dilution of ferromagnetic metal with antiferromagnetic one. 

However, in all these cases there can be some doubts about truly quenching of coupling constants. Furthermore, 
several independent mechanisms can be pointed out for relatively slow changing of coupling constants with time: 
• • ■ 1) diffusion of magnetic ions; 2) the distance between a pair of ions can be changed due to external variations of 
pressure 0. Such reasons very naturally induce developments of spin-glass models where coupling constants are 
not quenched variables a priori, but change with time, according to some slow stochastic process. It will allow to 
consider the different and perhaps unexpected case of a large but finite separation between relaxation times. If we 
start with some typical state far from equilibrium, and if the total relaxation time of the whole system is very large, 
then in some intermediate time regime the spins relax to a partial equilibrium with temperature T, while the coupling 
constants relax to a partial equilibrium at some different temperature Tj |l4|,[l8|,[l9| . For describing this regime, we 
can formally introduce two different thermostats with temperatures T and Tj. Later we shall introduce other infinite 
time scales but all these times are much smaller than the relaxation time towards the total equilibrium with the 
unique temperature. The usual spin glass model is recovered when Tj is infinite, because in this limit the coupling 
constants are totally independent of each other and of the spins. Moreover, with these general assumptions about 
time-scales and temperatures one can obtain the non-equilibrium stationary distribution in more general cases, and 
construct the appropriate thermodynamics. 
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First phenomenological spin-glass models with time-dependent coupling constants were considered by Horner p2[ . 
The two-temperature approach was introduced by Coolen et al. JTJ] and Dotsenko et al. H|. Recently one of us 
discussed a phenomenological two-temperature approach for describing the dynamics of model glasses in terms of a 
non-equilibrium thermodynamics. In this approach one temperature is the temperature of the thermal bath, while 
the second temperatures is self-generated and time-dependent, due to the non-equilibrium nature of the glassy state 
p5fl - P9| . Our approach in the present paper is complementary: We assume the existence of two fixed temperatures 
for the different components. It can be realized that different temperatures for different degrees of freedom, and 
large difference between the corresponding relaxation times are two necessary ingredients of so-called glassy behavior: 
Common action of these physical mechanisms ensures a specific, non-equilibrium regime of behavior. 

We shall investigate the two-temperature dynamics and statics of the p-spin interaction spin glass model |2l],|22|,^4| . 
Multi-spin interaction models arc not only a convenient laboratory for investigating phase transitions but also very 
well known in physics of magnets |6) . For example, this type of interaction is necessary for understanding properties of 
Hc 3 jlO| and metamagnets ||. The statics of the model is described by one step of Replica Symmetry Breaking (1RSB). 
The transition is first-order- type. Near the spin glass transition point the order parameter has a discontinuity 24\, 
but there generally is no latent heat. The dynamics of the model is analytically tractable and has a rich structure [22j. 
Due to the systems sensitiveness to the interchange of the limits N — * oo and t — > oo, there is a difference between 
the long time limit of the dynamics and the statics: The critical temperatures for the spin glass transition which are 
derived from the statics (where Gibbs distribution is assumed a priori) and from the dynamics (Langevin equations 
with typical initial conditions) are known to be different; this fact can be traced back to omission of activated processes 
in the mean-field dynamics p5| . There is a related difference in the thermodynamics of the system derived via the 
two approaches p6| . 

This paper is orga nize d as follows. In section |l| the dynamics of the model is introduced via a set of Langevin 



equations. In section III we discuss the case where the coupling constants are fixed with respect of the dynamics of 
the spins (adiabatic statics). For this case we construct an analog of the usual thermodynamics. The considerations in 
this section are actually more general, and do not depend on the details of the adiabatic system. This general theory 
is applied to the concrete case of the mean-field spherical spin-glass model in section [TV|. We also discuss different 
phase transitions which arise in this context. The detailed discussion of thermodynamical quantities is given. 

In section fv] the ergodic dynamic of the spin-glass model is investigated. As opposed to usual mean-field spin-glass 
systems this dynamic has a larger field of relevance in our case. We show in the adiabatic case that there is a difference 
between predictions of statics and long-time dynamics if the temperature of coupling constants is not larger than the 
temperature of spins. Effects connected with large observation times are discussed also. The summary of our results 
is represented at the last section. Some technical questions are considered in the appendices. 

II. THE MULTI-SPIN INTERACTION MODEL AND ITS HEAT BATHS 

In the mean-field spherical p-spin model we add a harmonic energy for the couplings, yielding 

l<i!<...<i p <N N l<i!<...<i p <N 

where = p\ J 2 / (2N P ^ 1 ) is the usual normalization factor for mean-field models, with J and v being fixed energy 
scales. We assume that the coupling constants and the spins interact with heat baths at temperatures Tj and T, 
respectively. The (overdamped) Langevin equations for the dynamics in this model have the following form: 

Td t a i = -ra i -^- + T] i (t), fa (t)ty (*'))= 2TT5ij5{t - 1') (2.2) 
fjd t J il ... ip =--^—+r Hl ... ip (t), (r,^ (t)r, h ... jp (t')) = 2TjT J 5 il .. Apdl ...j p 5(t-t') (2.3) 

OJi 1 ...i p 

Here r(t) is the Lagrange multiplier for enforcing the spherical constraint 53i°f(X) = N, while T and Tj are the 
damping constants. The coupling constants Ji 1 ...i v and the noises ^...i- are symmetric with respect of interchange 



of the indices. In Eqs. (2.2,p.3|) so called Einstein relation holds between the strength of noise and the damping 
constant. This means that the thermal baths themselves are in thermal equilibrium For ensuring the correct 
thermodynamical limit we must take: Tj = Tj/J^ (see Appendices A, B). 
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Straightforward calculations show that if v ~ Tj and the limit Tj i— > oo is taken first, followed by Tj t— > oo, then 
the coupling constants are quenched (with respect to the spins) independent Gaussian random variables. This limit 
thus yields the standard p-spin modelfsee Appendix A) . 

With help of standard methods [tu|]36f l we study the dynamics in Appendix B. We arrive at the following equations 
for the average dynamics of a single spin in the mean field caused by the other ones 

(Td t +r)a(t) = ^ / dte-( t -')/^CP~ 1 (i,t)a(t) 



2r 



where 



2« J-oo 

(V(t)v(t')) = 2TTS(t - + exp (-|f - t'\/rj)C^ 1 (t, t'), (2.4) 

2v 

tj = — (2.5) 

v 

is the timescale at which the couplings change. Details of the derivation of this equation can be found in the appendix 
B. 

Some comments about the general structure of Eq. (2.4) are at order. As it is well-known that the effective 
dynamical equations for spin-glass systems with quenched disorder are essentially non-markovian, i.e., they depend 
on the "history" of the process. Evidently, this arises due to quenching of a coupling constant with time. In our 
case — on account of the characteristic time (^^) — the non-markovian property is " smoothened" by the exponential 
kernel (see Eq. 



!£))■ 

With help of (2.4) we may derive coupled equations for the correlation function 



W) = ^E^w^')> ( 2 - 6 ) 

i 

and the response function 

describing the response of spin <ii to a small local field hi imposed on an earlier moment t', via an instantaneous 
change of the Hamiltonian as TL ^ TL — hia.i. To fix the units, we shall take T = 1 from now on. We find for t > t' 

(d t + r)C(t, = ^ f dte-^-^C^(i, t)C(t, t') 

21 J J-oo 

pTjj2 -{p-l) [ dte~^/ Tj C p - 2 (t,t)G(t,t)C(i,t') 



2v 

i ill i i ~ \ 

(2.8) 



J dtG(t',t) (^2TS(t-t) + ^^! e -l i - f l/ Tj C p - 1 (t,i)) 



(8t + r)G(t, = I Jte-WT'CP-^i, t)G(t, t') 



2Tj 

pTjJ 2 



(p-1) / dte-(*-^/ TJ C p - 2 (t,f)G(t,f)G(t,t'). (2.9) 



2v 

Generally speaking, both the relaxation toward a stationary state as well as fluctuations in that state are described 
by this closed pair of equations. Particularly, in the second case the time-translational invariance is expected to hold: 
one-time quantities do not depend of time, two-time quantities depend only on the difference of times: 

C(t,t')=C(t-t'), G(t,t')=G(t-t'). (2.10) 

This regime only applies in the limit when the initial time to goes to — oo; this was already inserted in the lower 
limits of integration of Eq. (2.9). Indeed, then the memory of the initial conditions is washed out, and the system 
relaxes toward its stationary state. It should be stressed that this infinity is taken only after the thermodynamic limit 
TV — > oo. t — t' can be viewed as an observation time, or as the finding of some clock designed to display the temporal 
dynamics of fluctuations. 
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III. TWO-TEMPERATURE ADIABATIC THERMODYNAMICS: GENERAL STRUCTURE 



Recently Coolen, Penney, and Sherrington llj j proposed a dynamical approach to the statistical mechanics of 
spin glass systems, where the introduction of replicas is not needed initially (though they enter later without the 
n — ► limit; see also [Q- ]l8|]). This approach can be called adiabatically static, because it is a static limit obtained 
by taking 



CO 



(3.1) 



(i.e., t j i — > co but v remains finite) immediately in the initial equations of motion (recall that tj remains much smaller 
than the initial time: tj -C | to 1 ) - For times much less than tj the spins will still see random couplings. As opposed 
to the standard case, the couplings are no longer uncorrelated. The correlation of couplings is coded in a finite Tj, 
and may lead to ne w p hysics. 

Equations ( |2.2] ),( f2~3|) can be investigated by the method of adiabatic elimination (see for example ||). Here we 
go further and construct t he c orresponding thermodynamics. For the case of a static distribution the procedure is 
as follows. First equation (2.2) is solved keeping the coupling constants J fixed (adiabatic following). Further, the 
Langevin equations in this case have the following equilibrium distribution 



P(a\J) 



exp[-/m(a, J)} 



(3.2) 



(In this section we do not write the spherical factor explicitly; the reader can consider it to be included in H(cr, J). 
The partition sum for given J-configuration is 



Z„{J) =Tr (7 exp[-/3H(a, J)} 



(3.3) 



In the evolution of the J-subsystem the averaging over the fast variables in ( |2.3| ) can be carried out. In general this 
should be in a sel f-consistent way. At quasi-equili briu m of the u- subs ystem this average can be performed and leads 
to the use of (3.2). In this way we get from eqs. (2.1), ( 2.2) and (2J3) a related dynamics for the couplings, in which 
H.(a, J) is replaced by — TlnZ (T (J), which plays the role of effective hamiltonian in the corresponding dynamics. 
Specifically we have the effective equation of motion 



Tjd t j tl . 



(3.4) 



As the noise is due to a bath at temperature Tj, see eq. (2.3), the equilibrium distribution of this equation reads 



P(J) 



where 



Z = J DJZ?(J) 
This approach introduces a 'dynamical' replica index 



The free energy follows from the usual formula 



T 



--\nZ = -T,\nZ 



(3.5) 



(3.6) 



(3.7) 



(3.8) 



Now we construct the appropriate thermodynamics for this two-temperature model using eqs. ( |3.5|) , fl3.6|) . We first 
need the joint distribution of a and J. As usual we can express the unrestricted probability P(u, J) in terms of the 
conditional probability P{a\J) as 



P(a, J) = P(J)P(a\J) = 



Zl 



■exp(-0H((T, J)) 



(3.9) 



For the total energy U we have 
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U = Tr ff J D J H(a, J)P(a, J), 



which can be viewed also as the average energy of the cr-subsystem. Direct calculations show that 



ld_ 

n d(3 



InZ 



U. 



ld_ 

ndfi 



InZ 



Tj 



U-Fr 



(3.10) 



(3.11) 



where 



Fj = - J DJ T\nZ a {J)P{J) 



is the self-averaged free energy of the cr-subsystem or the mean effective energy. 

We define entropies of total syst em a nd its subsystems by the usual Boltzmann-Gibbs-Shannon formula with help 
of the corresponding distributions (3.9). For example, the total entropy reads 



S = - J D J Tr CT P(cr, J) In P(a, J), 



(3.12) 



This involves just the general, statistical de finit ion of entropy for a macroscopic system, which is also relevant outside 
equilibrium Due to the decomposition (3.9) one gets two contributions, 



S = S a + Sj 



where 



S a = J DJ P(J) {-Tr a P(a\J)lnP{a\ J)} 



(3.13) 



(3.14) 



is our analog of the usual quenched average entropy of the spin motion (more precisely, it is the so-called conditional 
entropy pj), while the coupling-part of the entropy reads 



Sj = - J DJ P(J)]nP(J) 



(3.15) 



The analogous separation of the total entropy in two or more parts appears in other problems of statistical physics |37]] 
|p8| . In particular, it concerns the fine-graining procedure which introduces states of a statistical system relative to a 
fixed value of some properl y cho sen order parameter (a quantity under macroscopic control). Then the total entropy 
is also separated as in Eq. ( 3.13j ), where S a corresponds to average entropy of the relative states, and Sj corresponds 
to entropy of the order parameter itself. A simple example is just a piston separating a volume with a gas in two 
equivalent parts. Then S a is entropy of the gas in one part, and obviously Sj = In 2. A similar separation occurs in 
glassy transitions, where Sj corresponds to the configrational entropy or complexity [ p5| [ p6| . The famous phenomena 
of Maxwell's demon [[37J (proposed by Maxwell more than one century ago), and its subsequent reformulations and 
generalizations display that in a process of measurement S c can be decreased, instead Sj increases, and the total 
entropy S a + Sj can only increase. 

Let us consider now a generalized thermodynamics which arises in the context of Eqs. (|3.8|) -( 3.15 ). As a matter of 
fact, to generalize the usual thermodynamics we notice the following relations only 



F = Ft — TjS. 



(3.16) 



F = U- T,Sj - TS a (3.17) 



Eq. ( 3.16| ) is the usual thermodynamical formula for the J-subsystem. The second formula is more interesting 



because it gives a connection between the characteristics of the subsystems and the whole system. This agrees with 
the expression of the free energy for a glassy system put forward previously by one of us p^j27| , |28| . In that approach 
the equivalent of Tj is the dynamically generated effective temperature. 
These results can be written in the differential form 

dF = -S a dT - Sj dTj (3.18) 
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If we add an external field, it can be checked that 



dF = -So- dT - Sj dTj - M dH 



(3.19) 



This implies that the first law of thermodynamics takes the form 

dU = T dS a + Tj dSj - M dH 
As the last term can be indentified with dW, the work done on the system, the change in heat reads 

dQ = TdSv+TjdSj 



(3.20) 



(3.21) 



Eqs. ( |3.18 , 3. IE, 3.20) constitute a manifestation of a thermodynamic process in the following sense. A process is 
called "thermodynamic" if its characteristic time T t h is much larger than internal relaxation times of the considered 
system. Due to this condition it is possible to represent the process as a chain of stationary states. In our adiabatic 
system there are two relaxation times, r (an effective characteristic time of spins) and tj with tj 3> t. There can 
thus exist two types of thermodynamic processes: A slow one with Tth 3> tj r and a relatively fast one with 
tj 3> Tth ^> T - I n the s econd cas e the J-subsystem does not change during this process, implying, for example, 
dSj — 0. We see that ( 3.18 - 3.20 ) represent a slow thermodynamic process where states of both subsystems are 
changed. This classification allows us to discuss the question about heating or cooling of a two-temperature adiabatic 
system. If cooling is slow enough, typically both temperatures change; for example, in the extreme cooling process 
we can have Tj — > and T — ► simultaneously. In the opposite case of a fast cooling (or heating) process Tj is a 
constant while T varies in time. 

Irreversible effects also can be included in the present scheme. In general, irreversibility means that there are 
additional sources to increase entropy or decrease free energy. Namely it reads: 



dF <C — S(j dT — Sj dTj - M dH, 
dU < T dS a + Tj dSj - M dH 



(3.22) 



Eq. ( 3.17 ) can be easily generalized to a many- level adiabatic system where the first part of variables is slow with 
respect to the second part, the second part is slow with respect to third part,... For example, if we have a three-level 
system with the parts: {J}, {ai}, {02}, having relaxation times tj ^> t ITi ^> r CT2 



F — U TjSj T ai S ai T a2 S(j 2 



(3.23) 



It should be noticed, however, that on time scales of order t CTi , where interesting non-equilibrium dynamics of the <j\ 
system occurs, the ovsystem is in equilibrium, while the J-system is fixed; on the other hand, on timescales of order 
tj both the o\ and the gi systems are in equilibrium. A physical realization of this scenario occurs in glass forming 
liquids, with their fast and slow (3 processes, while the J-system then describes the configurational or a-processes. In 
this context Eq. (3.23) corresponds also to recently introduced models with two-level disorder: Coupling constants 
are also considered as frozen variables with respect to some other set of variables [Gl| (l(| . 



IV. ADIABATIC STATICS. 



In this section we investigate the adiabatic stat ic limit of the mean field spherical spin-glass model introduced in 
the section [El[ The free energy is described by ( |3.8| ). As in ref ^l| we have 

Z = II ( [ dqa f Xaf3 ) exp (—NG n (q a /3, X aP )) (4.1) 



a 6 



2G„(g Q/ 3A Q/ 3) = -nln27r - - q p a[j + qupKp + bidet (—A) 



r a/3 a/3 

const. - H <? a p - tr Hi), (4-2) 



G 



where fx = pTjJ 2 /2vT 2 q a g = (cr a crp) is the usual order parameter describing the spin-glass ordering, and \ a p are 
Lagrange multipliers [|l]]2|]. |j We have three independent parameters: T, Tj — T/n, and v. In this paper we consider 
phase transitions only in the following subspace of three dimensional space of the parameters: v = Tj, n = T/Tj is 
fixed, and the relevant parameter is T (of course, all such regimes with v ~ Tj are qualitatively equivalent). Thus for 
H we have the standard expression 



pP 2 j 2 



(4.3) 



As we have discussed in the previous section, there is some regime of cooling where n indeed can be a constant. 



A. Replica symmetric solution 



In the investigation of a spin-glass the first step is to make the Replica Symmetry (RS) assumption for the order 
parameter |lLE|: q a p — q (for a ^ (3), where q is the usual Edwards- Anderson parameter. In other words, one assumes 
that there is only one thermodynamical state (up to possible global symmetry transformations). The expression for 
the RS free energy f rs = F rs /N has the following form 



Wfr 



1 



m(l-< Z )--ln(l , 

n \ 1 - q 



1 + [n - l)q p ) 

P 



where q is determined by the saddle point equation 

nP- 1 - — 



(1 - q)(l + q(n - 1)) 



(4.4) 



(4.5) 



In section ^ we shall see that this equation can be obtained from the long-time statics if a slow dynamics for the 
coupling constants is assumed. Following (3.12)-(3.17) we get for energy and entropies 



2(3u r 



'-(l + (n-l)qn 



(4.6) 



2s a = ln(l -q) + 



±L ^(1-^) 

q + nq p 



(4.7) 



2s j = ln(l 



nq 



nq 



1 



1 



nq 



P 



(4.8) 



It is well known that from a point of view of phase transitions the set of p-spin models can be divided into the two 
main groups: p > 2 and p — 2. In the first case the qualitative phase diagram of the model does not depend on p (as 
long as it is finite). Thus in the main part of this subsection we investigate the case p > 2; our results for p = 2 will 
be presented at the end. 



We start with investigation of Eq. (4.5). For high temperatures there is only the paramagnetic phase with q = 0. 
The critical point Ti, rs can be defined as the first temperature where a non-zero solution of ( fi~5| ) is possible. For 
p > 2 there occurs a first-order phase transition point with discontinuity of the order parameter 



<Zl,rs — 



y/(2 - n) 2 (p - l) 2 + Ap(p - 2){n - 1) + (n - 2)(p - 1) 
2p(n - 1) 



The related onset temperature is 



J ^ | 1l,rs (1 ~ 1l,rs) (1 + (71 - l)qi, rS ) 



(4.9) 



(4.10) 



1 Besides ( |4.2| ) there is a contribution to the free energy which arises from the integration by the coupling constants, and has 
an order 0(N V In N). Usually this contribution is omitted (see |TJ| for example), because it does not depend on the order 
parameter. An alternative point of view is to consider (4.2) as the leading finite-size effect. 
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Some limiting cases can be investigated; for example, if p is large enough we get 




(4.11) 



Any physical solution must be stable against small perturbations, therefore the analysis of linear stability for a possible 
replica-symmetric solutions should be perfomed. The eigenvalues of the corresponding Hessian for a finite n were 
computed in pi] ]. There are three main sectors of fluctuations and the three corresponding eigenvalues: 

A 1 = - t x{p-l)qP- 2 + _ X ]T ^ Q/3 = (4.12) 



A 2 = Ai- ( 1 _ g) 2( 1+ 2 ( ) '_ 1)g) . $> Q/3 = (4.13) 



(3 a/3 



(1 - q) 2 (l + (n - l)g) V 1 + (n - l)g^ ^ 



The first eigenvalue, the so-called "replicon" or "ergodon" , is displayed by the most coherent fluctuations (RSB is 
checked usually by this eigenvalue); the third eigenvalue corresponds to the most non-coherent fluctuations, and the 
second one takes an intermediate position. Before investigating the stability of the non-zero RS solution, we first 
discuss which eigenvalue is relevant for different values of n, so which is the smallest one. A simple analysis shows 
that for n < 1 Ai is relevant, while for n > 1 A3 is the most dangerous one. This result is important: as we have seen, 
the relevant sector of the fluctuations depends on n, implying that the whole structure of the phase space has strong 
dependence on n also. At n = 1 A2 becomes relevant too, but it causes no extra problem, since we have Ai = A2. 

For p > 2 the paramagnetic solution q — is stable everywhere (the cas e p — 2 will be discussed at the end of this 
section). Now we c heck the stability of the nonzero solution of Eq. ([4.5|) for n < 1 . This solution monotonically 



decreases from ( |4.9|) to zero. From positivity of Ai we get 



q > P (4-15) 



Thus the nonzero solution is stable only for 



~ Trs ' st = J V 2(n + p-2)P (4 ' 16) 

Because T rStSt < Ti. rs we see that the solution is stable only for sufficiently low temperatures. In particular, for n = 
it is unstable for every temperature, and that explains why this solution could be discarded till now. On t he o ther 
hand, we shall show that if n > 1 the RS solution is stable everywhere. Indeed, for the nonzero solution of ([D^) A3 
is positive, and has the following form: 

a _ p(n - l)q 2 + {2-n){p-l)q + 2-p 

(1 - <z) 2 (l + (n - IW K ' } 

Further discussion about properties of replica symmetric spin-glass solution will be given after consideration of replica 
symmetry breaking solutions. In particular, we shall see that there are temperatures (T2 irs , T^^ rs ) of the true ther- 
modynamical phase transitions. 



n 






1.01 


0.6125 


0.5862 


1.10 


0.6271 


0.6001 


2.50 


0.8270 


0.7543 


4.00 


1.0052 


0.9213 


6.00 


1.2049 


1.1140 


10.0 


1.5289 


1.3567 



TABLE I. Ti.rs, and T2, rs for different n (n > 1), and p = 3. At T = T\. rs the RS spin-glass phase first appears as 
metastable one. The true first-order phase transition from the paramagnetic phase occurs at T = Ti, r s (J=l). 
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1. The case p — 2 



Let us now consider the special case p = 2. It is well known that the model with n = is described by a replica 
symmetric Anzatz and has interesting properties J39|. For example, the Ai eigenvalue vanishes everywhere in the low 
temperature spin-glass phase. For our solution we see (from ( |4.5| )) that in the same model Ai is always positive for 
nonzero n, since it holds that 

(1 - q y(l + (n- l)q) 

So the correlation between the couplings removes the zero modes and stabilizes the structure of the vacuum. Since 
A^(p = 2, n > 1) is also a positive function we see that for p = 2 the RS solution is stable for all n, and for all T. It 
will be evident later that a consistent RSB solution is impossible in this case. In other words, the model with p = 2 
is completely described by the RS anzatz. 
We get for p = 2 

qi „ . (i-;'+"- 2 > (4. M , 

4(n — 1) 

Now if n < 2 the phase transition is second-order, and Ti. rs coincide with true phase transition point into the 
spin-glass phase. For n > 2 the phase transition is first-order with the following scenario: besides Ti. rs , where the 
spin-glass phase occurs at the first time, there is also the true phase transition point T2 jrs < T\^ rsi that is determined 
by comparing free energies of paramagnet and spin-glass. These statements can be illustrated analytically in the case 



of positive but small n — 2. Starting from Eq. (4.4) we get 



n-2 2(n-2) . 
qi.rs = —z—, q2,rs = , (4.20) 



T hrs = J[l + ^-^-), T 2<rs = jfl + ^Jt). ,4.21) 



The difference between free energies of the spin-glass phase and paramagnet is positive at the transition point T = 

A/£7V S ) = > 0. (4.22) 

It means that the spin- glass phase appears as metastable one for n > 2. The free energies are equal at the second 
transition point: Af(T2 >rs ) = 0. Therefore this point must be considered as the temperature of the true phase 
transition from paramagnet to spin-glass. Indeed, for T < T2^ rs we have A/(T) < as it should be, since the 
spin-glass phase is more stable. Such a type of phase transition will be extensively discussed later. 

We have seen that a finite n removes the marginal states for the p = 2 model. In the section we shall see 
that a similar statement holds also for the case p > 2. But then the condition n > 1 is needed for stabilizing the 
corresponding marginal states. 



B. Replica symmetry breaking. 

Now we investigate Replica Symmetry Breaking (RSB) solutions. As we have seen in the previous subsection, for 
n > 1 the stability of a RS spin-glass solution gives some hint about irrelevance of RSB in this range of n. We shall, 
however, first discuss the case n < 1. We consider here only the first step of RSB (1RSB) because a more general 
type of RSB is not possible in this model; we omit the proof because it can be found in Q . 
Taking the usual steps || |2j we get the following equations 

in — 1 ft — vn 

2f3frsb = hi(l - qi) ln(l - (1 - m)q 1 - mq ) 

m nm 

--HI - (1 - m)qi + (n - m)q ) - £(1 - + m(gf - q p ) + nq p ) (4.23) 
n p 







where q a p takes the va lues q\ and qo, and m is the RSB parameter. For n 
f2lf . Following ( 3.12 )-( 3.17 ) we get for energy and entropies 



we recover the usual 1RSB equations 



2(3u rsb = -^(1 -q{ + miqf - <$) + nq?) 



(4.24) 



2s n 



Tfi — 1 I 

ln(l — qi) H ln(l - (1 - m)q 1 - mqo) 

m m 



qo 



1 - (1 - m)qi + (n — m)q p 



(4.25) 



2sj = — ln(l — (1 — m)qi — mqo) + ln(l — (1 — m)q\ + (n — m)qo) 



1 — (1 — m)qi + (n — m)qo p 
The saddle point equations are 



+ —(!-<£+ m(<£-gg)) (4.26) 



/ p-i P -i\ Qi — qo / . 

mi -% ) = 7; rr: T, v r (4-27) 



p-i 

m = 



(1 - (1 - m)q l - mq )(l - (1 - m)q 1 - (m - n)q ) 



(4.28) 



On time scale tj the spin system will, by definition, be in equilibrium. Therefore m is determined also by its saddle 
point equation, 



%l-ql) = — 2 \n(l- 
p m z \ 

n-m qi - q 



- go) 



qi - qo 



nm (1 — (1 — m)qi — mqo) n (1 — (1 — m)qi — (m — n)qo) 



(4.29) 



There is some other possibility for fixing m: As was shown before 11 |g2j this parameter can be fixed also by 
the so called " marginality condition". The resulting theory describes metastable states, in a manner also monitored 
by the dynamics [g2j (see also section ^). In this paper we consider only the purely st atic condition ( 1.2S ). 

First we note that there is a remarkable analogy between the RS finite-n free energy (4.4) and the free energy of the 
1RSB solution with qo = 0. If we interchange q\ with q and m with n we arrive at identical expressions. This analogy 
between corresponding free energies was considered in the SK model with similar but more complicated techniques 
including two types of frozen variables pl| . Recently XY spin-glass model has been investigated by the same approach 
p6| . We shall show that a similar, perhaps more informative analogy can be found in the dynamics of the present 
model. 

As well-known, the physical interpretation of replica symmetry breaking is connected with decomposition of the 
phase space into pure states (ergodic components) JiJ (2). This structure is contained in the overlap q a p. In particular, 
for 1RSB the values q±, qo can be interpretated as self-overlap of a pure state and mutual overlap between two pure 
states. This information is coded also in the probability distribution of overlaps: 



P(q) 



n(n — 1) 



1 — m . . m - n 

-d[q - qi) + d(q - qo) 

1 — n 



(4.30) 



It is assosiated with the fraction of matrix elements q a p which take the value q\ or qo • We see that for interpretation 
of (1 — m) / (1 — n) and (m — n)/(l — n) as (non-negative !) probabilities we need: 



11 < to < 1 for n < 1 
1 < to < n for n > 1. 



(4.31) 



One could expect that the conditions (4.31) are satisfied automatically if other more obvious physical conditions (for 
example, q\ > qo) are valid. However, it is not so. Later we shall show that they should be considered as additional 
conditions selecting the correct solution. 
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1. Replica symmetry breaking with vanishing lower plateau 



Let us now discuss the solution of Eqs. ( 4.27| ), (4.2£) for the case go = 0- T hen t he solution itself becomes 
independent on n. However, the dependence on n does enter through Eqs. ( 4.30 ), ( 4.31 ). The consid ered sol ution 
has partly been investigated in H]. First we note that there is a convenient parametrisation of Eqs. (4.27), ( 4.29| ) 
[^l|,Q. If we denote 



mqi 

then for this quantity we get the temperature independent equation 

„2 



P 



= (l + c)ln(l + c) -c 



(4.32) 



(4.33) 



The positive solution of this equation should be selected. (The authors of |2lJ employ the slightly different variable 
y = l/(c+ 1)). Taking this into account, the equation for qi reads 



p-i 
Mi 



(i + c )(i- gi ) 2 

The highest temperature for which this equation has a non-zero solution will be denoted by Xi ;rs &: 



(4.34) 



2+rsb — J\ 



'2(1 + c) (p-2 



p-2 



(4.35) 



and qi at this point has the value 



qi{Tl.rsb) 



(4.36) 



Further, using ( 4.32 ) we get 



m(Tx,rsb) 



2c 
p~2' 



(4.37) 



This value is greater than 1 for al l p > 2. The parameter m monotonically decreases with temperature from ( 4.37 ) at 
T = Xi rsb to zero at T — (see ( 4.43] )). It means that for n > 1 only a part of the solution fro m m {T\ rs b) to m = 1 
can be physically permissible; otherwise we get physically meaningless results for the weights (4.30). Namely, if n is 
in the interval 1 < n < m{Ti rs i l ) 1 then the temperature where the solution appears as physical one will be determined 
from the condition m{T) = n. In the opposite case where m(Ti !rs {,) < n, that temperature is just Ti jrs b itself. 

On the other hand, in case n < 1 the physical part is consistent only with n < m < 1. Namely, for n < 1 the 
possible transition point must be determined from the condition m = 1. The transition from paramagnet to RSB 
spin-glass with vanishing lower plateau with m = 1 at the critical point has been found in [^H for n — 0. It occurs at 
the temperature 



T- 



2,rsb 



2(1 + c) 



l + c 



2-p 



At this point q\ jumps from zero to 



31 (T s 



2,rsb) — 



C+1 



(4.38) 



(4.39) 



and it goes monotonously to unity when T tends to zero. The transition is intermediate between first-order and 
s econd-ord er: the order parameter has a jump but the energy and entropy are continuous, as we see from Eqs. 
Q4.24H4.26l) . 

Note that the free energy in the spin-glass phase is higher than that of the paramagnetic state (Fig. Q). It is usual 
for this type of phase transitions 0] 0] ]3l]] pl[ . 
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FIG. 1. The free energy (subtracted the paramagnetic contribution) of the 1RSB spin-glass phase with vanishing lower 
plateau vs. temperature (p — 3). For n > 1 (n < 1) a par t of the right-hand (left-hand) branch of the presented curve should 
be chosen as the physically permissible one (see Eq. (4.30)). It turns out that the chosen part of the right-hand branch always 
corresponds to a metastable phase. 



If p i— » oo then also c i— ► oo. More concretely, in this limit it holds that 

J 2 / 1 \ 

■> (In c — 1) exp I I i ► oo 



IT 2 



ln< 



1 



(4.40) 



?1 



1 

1 - - 

c 



(4.41) 



This behavior in the large-p limit is in the sharp contrast with the case of p-interaction Ising spin-glass (2Cj , where 
phase transition point is finite when p t— > oo. 

Let us now consider the zero temperature behavior of the solution with fixed but not very large p. A simple analysis 
shows that in this case 



T 

<?i ~ ~f 



jy p(i 



(4.42) 



in 



T 



J Vp(l + c)' 



(4.43) 



f(T ^ 0) = - 



J(c + p) 



(4.44) 



Note again that the free energy of the solution remains finite in the zero-temperature limit in contrast to the param- 
agnetic free energy which tends to minus infinity. 

The considered solution is stable and all relevant eigenvalues of the Hessian are nonzero at the phase transition 
point. In particular, for the relevant eigenvalue: (see |21| for the derivation) 



Ai 



p-2 



1 



(l-<7i) 2 ' 



(4.45) 



we get from Eq. (4.34) 
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Ai 



(l-<Zi) 2 



1 - 



> 0. 



(4.46) 



The eigenvalue ( 4.45| ) describes fluctuations deep inside a pure state. As usual, critical slowing down is absent at 
this static first order phase transition. Later we shall show that in the long-time dynamics there occurs a marginal 
stability for all n < 1. 




FIG. 2. The entropies (subtracted the corresponding paramagnetic contributions; see Eqs. (4.25), (4.26)) of the 1RSB 
spin-glass phase with vanishing lower plateau vs. temperature (p = 3, n = 0.5). (a): So-, entropy of the spins; (b): s, the total 
entropy; (c): sj, entropy of the coupling constants. The curves start at the transition point T = T^^sb- 

It is of interest to discuss th e behavio r of entropies s CT , sj, and s in the vicinity of the transition point T^rsf,. In 
particular, we have from Eqs. ( 4.24 - 4.26 ) 



2s a = ln(l - q x ) + — ln(l + c) + -(1 - (1 - 771)9?) 
m p 



(4.47) 



2sj = ^(l-(l-m)gf) (4.48) 
P 

In spite of the jump of qi, they change continiously from the paramagnetic phase to the spin-glass one. We shall 
compare their behavior in spin-glass and paramagnet at the same value of temperature. For T < T2^sb the entropy of 
the spins is higher in the spin-glass phase: s CT > s a ( qi — 0). On the other hand, the entropy of the coupling constants 



is lower: sj > sj(qi =0), as is obvious from Eq. (4.48). Consequently, the total entropy s = s a + Sj is also higher 
in the spin-glass phase as compared to its value for q\ — 0. The behavior of the entropies is presented in Fig. |^. 

Further properties of the RSB spin-glass phase (in particular, for n > 1) will be discussed later in the context of 
construction the complete phase diagram. 



2. Replica symmetry breaking with non-vanishing lower plateau. 



A solution with q emerging smoothly from q = is not compatible with the saddle-point equations (4.27). 
Therefore we investigate a continuous transition from the RS solution with q = qi > and a RSB soluiton with 
qi > 0, qo > but small Aq = q\ — qo- With this assumption we have the following equations at the transition point 

/i e (p-l)gr 2 = 1 (4.49) 
(1 - QcY 

Vcq%~ 2 = T, \7i — ~~7 7^ ( 4 -50) 

(l-?o)(l + (n-l)g c ) 



13 



The first of these expresses that the replicon eigenvalue Ai of a RS solution with q = qi vanishes. The transition 
point is thus given by 



T 



Jn p (p-2)P-2(p-l) 
V 2 (p - 2 + n)P 



(4.51) 



In the limit p i 
parameters go 



• oo this transition point remains finite, and for any p it tends to zero if n tends to zero. The order 
qi have the following jump at the phase transition point 



q<: 



p 



p-2 



(4.52) 



As we see, it is the same point where stabilit y of th e RS sp in-gla ss solution is restored. 
There is a useful parametrization of Eqs. ( 1.27 ), ( 4.28 ), ( 4.29 ): if we introduce 



go 

qi ' 



mAq 



then we have 



t v - px v-i(i- x ) (l + c )ln(l + c) 



p(l - xP- 1 )^ - x) 



Using Eqs. ( 4.53 - 4.54 ) we get at the transition point: 



n 
2 



(4.53) 



(4.54) 



(4.55) 



It can be proved t hat m decre ases with decreasing of temperature, and m = when T = 0. According to our 
discussion at Eqs. ( 4.30 ), ( 4.31 ) it means that a 1RSB phase with no n- vanishing lower plateau cannot be considered 
as a physical one, at least not for n < 2. For n > 2 and then m(T) > 1 this solution also cannot be considered as a 
physical one, because then the condition q\ > qg is violated (this condition does not depend on n, and it is neccessary 
for the interpretation of go and q\ as overlaps). 

This behavior is in the sharp contrast with SK model jl9| |18| where the main effect of finite n is to introduce 
a non-vanishing lower plateau. This plateau increases with n, and re plica symmetry breaking disappears at some 
critical value. It should be noted that in our case only the property (4.31) forbids the existence of the considered 
phase for n < 2. All other requirements are satisfied: it is stable, and has well-defined free energy. Stability can be 
checked by positivity of the following eigenvalues 



Ax = - M (p-l)?r 



1 



(l-<Zi) 2 



(4.56) 



A 



-H(p - l)ql 2 + 



1 - qi + nq Q 



(1 - <?i)(l -qi + mAq + nq ) 



(4.57) 



We should mention the possibility of more general replica symmetry breaking solutions in our model. For n — it was 
proven H] that 1RSB solutions are the most general RSB ones, and more orders of RSB are impossible. This proof 
can be generalized also for n > 0. The physical meaning of this statement is that a finite n introduces correlations 
between coupling constants partially removing frustrations. In other words, it cannot lead to more complicated phase 
space with more orders of RSB. 



C. The static phase diagram. 



In this subsection we construct the phase diagram of o ur m odel by considering all physically relevant solutions 
(it means stable and with correct probability of overlaps ( 4.30| )): paramagnet, RS spin-glass, RSB spin-glass with 
vanishing lower plateau. 
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1. The case n < 1. 



First we discuss the case n < 1. For high temperatures the system is in the paramagnetic phase. If temperature 
decreases, then at T = T 2<rs b (see Eq. (4.38)) the RSB spin-glass with vanishing lower plateau appears. Its free 
energy is greater than the paramagnetic one (see Fig. [I]) but, nevertheless, it is chosen as the relevant phase. It is the 
usual choice, and a possible argument is a hypothesis about a non-perturbative instability of the paramagnetic state 
below T2.rsb- As far as we know, there is no convincing proof of this statement. There is only some hint gained from 
an analysis of finite-size corrections in Potts glass |3l|] . As we have mentioned already, this phase transition is first- 
order with respect to the order parameter but second-order with respect to derivatives of free energy. In particular, 
the latent heat (the difference between the energies of the high temperature and the low temperature phase at the 
transition point) vanishes. 

At the present stage we shall go back t o the RS spin-glass solution, and analyze its free energy. Recall that this 
phase is stable for T < T rs ^ s t (see Eq. (4.16)), and for some range of n we have T rStS t > T2, rs b (see Fig. |J). In 
particular, the sign of 



T 



T 



Afrs = f rs - fpara = ~ ^ M 1 ~ 0) ~ q~ ln ( 1 



nq 

T 7 ? 



(4.58) 



should be checked. In this respect the interval < n < 1 is divided into two subintervals. For no < n < 1 
(where no is some positive value, to be discussed later) it holds that Af rs (T rs , s t) < 0. Taking into account that 
at T = T rs>s t RS spin-glass first appears as a physical solution, we conclude that in this range of temperatures it 
should be considered as metastable with respect to the paramagnet, in spite of its lower free energy. The opposite 
point of view will mean that T = T rs . s t must be considered as the point of a phase transition which is meaningless, 
because Af rs (T rsst ) ^ 0. If temperature is decreasing further we get the point T — T 2rs where Af rs (T 2rs ) = 0, 
and Af rs (T rSySt ) > for T 2yTS > T. This behavior of the free energy is presented by Figs. ||, |J. However, this point 
is always lower than the transition temperature from the paramagnet into the RSB spin-glass phase with vanishing 
lower plateau: T 2trs b > T 2 rs . (On the other hand T 2irs f, < T 2 rs for 1 < n, but this case is physically different and 
will be discussed a bit later.) Therefore, the temperature T = T 2 .rs is not considered as a true phase transition point 
towards the most stable phase. Certainly, it is only the point where RS spin-glass phase becomes more stable than 
the paramagnetic state. 

For n < no one has A/ rs > 0, so the RS spin-glass state at the beginning appears with higher free energy than the 
paramagnet. hq is defined by the condition Af rs (T rs ^ st ) — 0. In Table I we represent the values of uq for different p . 
In particular, we see that no(p) decreases with increasing p. 



n 


P 


0.68632 


3 


0.61605 


4 


0.53108 


6 


0.36803 


18 


0.31670 


30 



TABLE II. n for different p (J = 1) 



Accordi ng to E qs. (4.30), (4.31) for n < 1 any 1RSB spin glass cannot exist as a physical one if m < n. From 
subsection IV B 1 wc know that for the RSB spin-glass with vanishing lower plateau m monotonically decreases with 
temperature from m = 1 at T = T 2 rs i, to m — at T — 0. It means that a phase transition should exist from a RSB 
spin-glass with vanishing lower plateau to a RS spin-glass at a temperature T3. rs defined by 



m{T a>ra ) = n. 



(4.59) 



n 


-^3,rs 


0.90 


0.5575 


0.80 


0.5240 


0.70 


0.4805 


0.60 


0.4413 


0.25 


0.2326 



TABLE III. The transition temperature Tz, rs from the 1RSB spin-glass phase to the RS one, for different n (n < 1), and 
p = 3(J=l). 
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f-f. 
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0.0004 




FIG. 3. Free energies (subtracted the paramagnetic free energy) vs. temperature (n = 0.955, p — 3). Thick line: the RS 
spin-glass phase; normal line: the RSB spin-glass phase with vanishing lower plateau. The arrow denotes the phase transition 
point occurring at T = Ts^s from the 1RSB spin-glass phase to the RS one. 




FIG. 4. Free energies (subtracted the paramagnetic contribution) vs. temperature (n = 0.8, p = 3). Thick line: the RS 
spin-glass phase; normal line: the RSB spin-glass phase with vanishing lower plateau. The arrow denotes the phase transition 
point at T = Ta jrs . 
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As Eqs. (4.23)-(4.29) show, the order parameters are equal at this point: q\ = q. It is also easy to show that 
the free energies, energies and entropies s a , sj of the corresponding phases are also equal. Thus, at T = T^ tTS the 
order parameter q$ jumps from zero to q\, ensuring the replica-symmetric behavior for T < T3 >rs . On the other hand, 
qx changes continuously. Both the RS spin-glass and the RSB spin-glass with vanishing lower plateau are stable at 
and around T = T^^ rs . In this sense the transition at T = T^ trs is very similar to the transition occurring from the 
paramagnetic state at T = T^^f,, where qo changes continuously (i.e., remains zero) but q\ has a jump. It is worth to 
note that for T < T^,rs the free energy of the RS spin-glass is lower than the free energy (more exactly its analytical 
continuation) of the RSB spin-glass with vanishing lower plateau. Different values of T^^ rs are presented in Table II. 

Summarizing the presented facts and arguments, we conclude that when temperature is decreasing for fixed n < 1 
there are only two temperatures of true phase transitions: 1) T = T2. rs b is the transition point from the paramagnet to 
the RSB spin-glass with vanishing lower plateau. 2) T — T 3 rs is the transition point from the RSB spin-glass into the 
RS one. These transitions are quite close by their physical meaning. The main distinction is in the difference between 
free energies of the corresponding low-temperature phase and the high-temperature one (or rather its analytical 
continuation to lower temperatures). The temperatures T rS}St and T2 <rs also have certain physical meanings, but are 
not considered as true transition temperatures. 




FIG. 5. Thermodynamical functions (minus the corresponding paramagnetic contributions) of the RS spin-glass (n = 4, 
p — 3) vs. temperature. The thick arrow denotes the phase transition point from paramagnet to the RS spin-glass phase at 
T = T2,rs- The normal arrow denotes the temperature T = T\, rs , where the RS spin-glass solution appears first as a metastable 
phase. Thick line: free energy; (a): sj, entropy of the coupling constants; (b): s, the total entropy; (c): it ra , mean energy; (d): 
Sa, entropy of the spins. 
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2. The case n > 1. 



In the case n > 1 there are three relevant solutions: the RS spin-glass (q > 0), the paramagnet (q = 0), and the 
RSB spin-glass with vanis hing lower plateau in the region 1 < m < n. Recall that this last state formally exist for 
T < Ti^sb (see Eq. (4.35)), but the region of its actual existence must be chosen according to the value of n as it 
has been done for n < 1. Doing so we immediately conclude that for n > 1 the RSB spin-glass with vanishing lower 
plateau cannot be considered as the most stable one, because its free energy is always higher than the free energy 
of the paramagnetic state (Fig. [l]). It can be viewed only as a metastable one in the above-mentioned region. The 
behavior of the corresponding free energy is presented in Fig. [|. Therefore, our attention will be restricted only to 
the paramagnet and the RS spin-glass phase. 



According to our discussion in subsection [IV A| , a RS spin-glass phase first appears at T — Ti_ rs (Eq. ( |4.9D ) but its 
free energy at this point is higher than the paramagnetic one. These free energies are equal when T — T^,rs^ and for 
T < T2 : rs the RS spin-glass phase has lower free energy. Thus, the temperature Ti. rs is the true thermodynamical 
phase transition p oint . This transition is first order, and it is connected with a jump of the order parameter q. It is 
obvious from Eq. (4.6) that for T < T-^^s the mean energy of the spin-glass phase is also lower than the paramagnetic 
one. It means that the latent heat is positive as for (usual) first-order phase transitions in equilibrium systems. Values 
of Ti jrs , and T^rs are represented in Table III. In particular, this scenario of phase transition is the usual one for multi- 
spin interaction ferromagnets Q [ft0||, for some metamagnetic materials Q or for phase transitions in a compressible 
lattice [||. For such a system the jump of entropy at the transition point is negative (i.e., a low-temperature phase 
has lower entropy) according to the usual relation F = E — TS between free energy, energy and entropy. At this stage 
it should be recalled again that our system is not in the usual equilibrium, a nd we are considering phase transitions 
in the nonequilibrium steady state. In particular, we have the basic relation ( 3.17 ) between free energy, energy, and 
entropies. At the transition point T = T2,rs this relation can be written as 



Au = TAs tT +T J As J , 



(4.60) 



where Am = u rs — u pm , As a — s a ^ rs — s CT)Pm , and Asj = sj, rs — sj. pm are differences betwee n th e corresponding 



quantities of the RS spin-glass and the paramagnet, and u rs , s a . rs , sj. rs are defined by Eqs. (|4.6|)-([4.&j). Further, 
T and Tj are connected through T = T2. rs - In particular, positive latent heat means Au < 0, and consequently 
TAs CT + TjAsj < 0. However, it is interesting to know signs of As CT , Asj, and As = As a + Asj separately because 



these quantities have independent physical meanings, extensively discussed in section HI. We get 



As > 0, Asj > 0, As^ < 0. 



(4.61) 



The behavior of As is in the sharp contrast with the usual, equilibrium first-order transitions. This somewhat 
surprising fact should deserve further attention. The behavior of various thermodynamical quantities near T2,rs is 
presented in Fig. ^[ The difference between spins entropies Aso- becomes positive starting from some temperature 
lower than T 2jI . s . In other words, for sufficiently low temperatures both entropies are higher in the spin-glass phase. 
Let us recall in this context that free energy and mean energy of the spin-glass phase are lower than the paramagnetic 

ones for sufficiently low temperatures. 

Positivity of the latent h eat, and the result (4.61) holds also for the first-order phase transitions occurring for p = 2, 
n > 2 (see section [V A l|) . In the case of positive but small n — 2 we can get analytical expressions for As a , As,/, 
and As using Eqs. ( 4.20 - 4.22 ). The jump q2, rs of the order parameter is positive but small at T = T2, rs , and we get 
to leading order 



= -\ql, rs + 0(ql rs ) < 0, Asj = X -q\ rs + 0(ql rs ) > 0, 
As = ^ql rs + 0(qi rs ) > 



(4.62) 



This is an analytical illustration of the more general result (4.61). 

The special attention should be devoted to the case n = 1. The free energy, and the energy of the RS spin-glass 
coincide with their analogs for the paramagnetic phase. However, from the point of view of the order parameter, 
the phase transition occurs to the RS spin-glass phase (when decreasing temperature for a fixed n = 1). Further, q 
increases monotonically from q = (p — 2)/{p — 2 + n) at T = T2. rs b — 22,rs — ^3 )rs to q = 1 at T = 0. The phase 
transition is first-order for p > 2, and second-order for p = 2. It is interesting that s a and sj depend on q even for 
n = 1, however, they compensate each other so that their sum s = 0. The final phase diagram is presented in Fig. [7]. 
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n 




SG-2 



(a) 



PM 



FIG. 6. The static phase diagram of the model in the n — T plane for p = 2. The paramagnetic phase is denoted by PM, 
and SG-2 means the RS spin-glass phase, (a) T = J, the line of the second-order transitions; (b) T = T2, r s(n), the line of the 
first-order transitions with a positive jump of the total entropy. The thick dot indicates the multicritical point. 




FIG. 7. The static phase diagram of the model in the n — T plane for p > 2. The paramagnetic phase is denoted by PM, 
and SG-1, SG-2 mean correspondingly the RSB spin-glass phase with vanishing lower plateau, and the RS spin-glass phase, 
(a) T — T2 >rs b(p); (b) T = Ts >rs (n,p); (c) T — T2, r s(n,p). The lines (a) and (b) indicate first-order transitions without latent 
heat; (c) indicates the first-order transition with the positive latent heat, and a positive jump of the total entropy. The thick 
dot indicates the multicritical point. 
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V. ERGODIC DYNAMICS 



At the present section we consider the ergodic (or time-translation invariant) dynamics of our two-temperature 
model. As can be expected from our experience acquired from the study of statics, if n < 1 ergodicity holds at 
relatively short but infinite times where RSB is not relevant (of course, that restriction of times is not essential if 
temperatures is high enough). On the other hand, if n > 1 the assumptions connected with ergodicity are correct 
for any temperature. Indeed, in the last case the RS assumption adequately describes the system's state for all 
temperatures. Thus, as opposed to the case of usual mean-field spin-glass systems (with n = 0), in our case ergodicity 
can have a wider range of applicability. In particular, in the present section we compare the predictions of the 
long-tim e dynam ics with the static ones, as well as investigate effects connected with very large observation times. 



Eqs. (2.8, 2.9 ) have the following form in the time-translation invariant regime 



(8 t + r)C{t) = %L I die- l l TJ C p - l $)C{t - t) 



2rj jo 

72 



-^r^-(p-l) / dte-*/ TJ C p - 2 (F)G(f)C(t-t) 
pTjJ 2 <-°° 



(i 



2« Jo 



<£ e -<. t +f)/ T ->C p - 1 (t + i)G$) i (5.1) 



(d t + r)G(t) = / dte-^-^CP-\t - t)G(t) 
21 J Jo 

2v . L 



(5.2) 



A. Adiabatic dynamics: not very large observation times. 



We come to the adiabatic statics, which has been considered in section III, from the dynamics if Tj i— > oo before 
1 1 — y oo , so that the usual form of FDT 

d t C{t)=T{-G{t) + G{-t)) (5.3) 

can be used. Indeed, in this case for all t -C tj the coupling constants are fixed, and the violation of the detailed 
balance condition (which arises in account of a difference between temperatures) cannot be effective. Thus we have 
the equation 

J'2 



(d t + r)C{t) = J— / dte-^C^^Cit - t) 
21 J Jo 

+ E ^(P - 1) I" die-^CP~ 2 (t)C(t - F)G(t) 
2v Jo 

PTjJ 2 

2v 



die- l ' TJ G(t)C p - x {t + t) (5.4) 

In the last two integrals we can take e - */ Tj ~ 1 by considering the relevant domain of the integration. In the first 
integral we find by a changing variables 

— / dte-^CP-HhCit-f) h+ -q p , (5.5) 
r J Jo v 

where 

q = lim(_ >00 (lim rj _ >00 C(t)) (5.6) 

Now for investigating phase transitions we take our usual restriction t o th e parameters of the model: v = Tj, n = T/Tj 

is fixed, and T is varying. Thus /i = pf3 2 J 2 /2. The static limit of (5.4) gives us the RS equation (O). Indeed, for 
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determination of q we can take the two limits: t — where C(0) = 1, dtC(t)\ t= o = —T, and 1 1— > oo where C — q. For 
these cases we have the following equations 

0r-l = n<nq p + //(l - g p ) (5.7) 



f3rq = finqP + fi(q - q p ) + fiq p Hl-q) 



(5.8) 



These equations reproduce eq. (4.5), but now as a result of long-time dynamics. As was shown in section IV 
non-zero solution of this equation correctly describes the low-temperature phase of the system for n > 1 



the 



For obtaining 

the RSB equations from the dynamics a non-ergodic regime should be considered; it will be considered elsewhere. 

We see that the replica-symmetric equation for the order parameter can be found from the ergodic dynamics. But 
in systems with first order phase transition predictions for long-time dynamics and statics can be different. What is 
the meaning a dynamic phase transition? Our starting point involved Langevin equations which are first order with 
respect of time (more exactly, they are the overdamped limit of the true Langevin equations) . Thus our dynamics 
is purely relaxational. In other words, we must have: dtC(t) < 0. Of course, if the temperature is high enough 
then dtC(t) < 0. We can determine the dynamic phase transition point by the following two conditions: it is the 
temperature Td where dtC(t) — 0, and for all T < Td we then have dtC(t) > 0. If such temperature exists, then a 
contradiction arises because we know that the dynamics is purely relaxation. The only way to solve this contradiction 
is to assume that the ergodicityis broken for all T < Td. 

By the same methods as in [g2| we have from (5.4) 



(d t + r)C(t) = fjTC(t) + {fir -n- 1)T + iiTC p - l {t){l - C{t)) 
-fiT [ dtd- t C{t) [C p -\t - t) - C p -\t)] 



P J 2 
'IT j 



dte-* /Tj C p - 1 (t)(C(i - 1) - C(i)) 



(5.9) 



We find that for large t and n < 1 the dynamical stability condition dtC(t) < is equivalent to the following two 
equations, which were obtained already in 



pr-ii = f(C(t)) 
f'(C(i)) = 0, 



where 



f(C(t)) 



1 - C(t) 



(5.10) 



(5.11) 



These equations predict a phase transition at the temperature (assuming that it is the highest temperature where a 
phase transition from paramagnet occurs) 



2 _ pJ 2 (p 
- 



2 {p-iy- 



(5.12) 



with jump 



Id 



p-1 



(5.13) 



The standard interpretation of this phase transition is the following |f22|-p4 32 1. The dynamics is investigated in the 
limits: the initial time — ► — oo after the thermodynamic limit N — > oo. In contrast, in the purely static investigation 
by means of the Gibbs distribution, the opposite order of limits is implicated. Thus in the long-time dynamics the 
system can be blocked in some regions of the phase space. It was shown that, indeed, the dynamical phase transition 
is induced by the highest metastable TAP states |23| which are separated by each other by means of infinite barriers 
(in the thermodynamic limit). The dynamical phase transition can b e reflected by an other approach also |E3]: As 
we have seen in section IV, the relevant eigenvalue of Hessian is ( 4.12j ) 



Ai = -li(p - l)q p - 2 + 
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(which does not dependent on n). By now considering a "long-time" but not purely static regime, the RSB parameter 
m can be fixed by the condition Ai = 0. In this approach (marginal replica theory) the phase transition point 
coincides with the dynamical one, but the thermodynamics is different compared to the one which is obtained from 
the long-time limit of the dynamical equations. 

We have seen that the dynamical transition point is independent of n if this temperature is larger than all other 
transition points predicted by statics. A simple comparison gives the following. For all < n < 1 there is a difference 
between st atics a nd dynamics: Td > T2,rsb > Tz,rs- It coincides with the fact that for this case the relevant eigenvalue 
of Hessian ( 4.12 ) does not depend on n. There is no such difference for n > 1, because in this case the statics predicts 
a phase transition at a greater temperature than the dynamics: Ti !rs > T2,rs > 2V Indeed, in this case the replicon 
or ergodon eigenvalue Ai is not a relevant one. 

We see that the existence and probably the structure of the highest metastable TAP states strongly depends on n. 



B. Adiabatic dynamics: very large observation times. 

In this subsection we have concentrated exclusively on the case n > 1; it was mentioned above that in this case 
ergodicity is valid without any constraint on the temperature or the time of observation. As we have seen in previous 
subsection, there is a spin-glass phase if the observation time is not very large, i.e., if t <C tj. Further, the same result 
as predicted by the long-time dynamics can be obtained from the statics. However, for t ~ tj (i.e., when an observer 
waits long enough) the coupling constants will begin to fluctuate and relax toward their steady state. It is expected 
intuitively that at such observation times the spin-glass phase will disappear, and the resulting stationary state will 
be a paramagnet. As a matter of fact, this subsection is devoted to confirm that point of view. Furthermore, we will 
see that there are some peculiar features of this process, which probably have universal character related to other 
glassy systems. In the concrete calculations we use the methods of |fZ2| . 

In the domain t ~ tj — > oo the main t ime-scale is tj; thus, it is natural to take the following form for the correlation 
and response functions 

C(t)=c(-),G(t) = -g(l-) (5.14) 

(the extra factor 1/tj for Q appears on account of the correct dimension of that quantity; furthermore its necessity 
will be evident further). Let us define also an auxiliary large time-scale t e at which the correlation function stabilizes: 
C(t ~ t e ) = q (where q is defined by Eq. ([D])). Let us stress that when in the previous subsection we have spoken 
about very large t where C(t) — q, we meant — in the light of the present discussion — the case t ~ t e . 

Now our very large time-scales can be presented as: tj ^> t e ; the cases t ~ t e and t < t e have been studied in the 
previous subsection, and now we arc going to consider the cases t ~ tj , t 3> tj . The corresponding equations for C, Q 



must be constructed from (5.1, 5.2) in accordance of a simple physical picture occurring from the large separation of 
the local relaxation times. Namely, if the temporal argument of C(t), G(t) is less or equal t e , then the case of not very 
large observation times holds with all its consequences. For instance, the usual FDT can be used. At the same time 
the kernel exp(— i/rj) can be put equal to unity, as we have done more than once in the previous subsection. If the 
corresponding temporal argument has at l east the same order as t e we should take into account that C(t ~ t e ) = q, 



and if it has the same order as tj we use ( [5.14 ) accompanying with an evident consistency condition C(0) = q. 



Our transformations come to dividing the dom ains of integration in Eq. ( p.l[ ) into two parts: from to t e , and 
from t e to oo (the corresponding integrals in Eq. ( |5.2| ) are divided into three parts because more accuracy is needed: 
from to t e , from t e to t — t e , and from t — t e to oo). Now every part is trea ted as des cribed above. We omit all 



factors which have relatively small order when tj — > oo. In particular, for Eq. (5.1) ((5.2)) these factors are of order 
O (1/rj) (O (1/rj)). 

Finally, we get the following equations (where s = t/rj) 



rC(s) = 


P J 2 r 

2v J 


pTjJ 2 


/ dse 
Jo 


2v 


PTjJ 2 




2v 


rQ(s) = 


P J 2 r 

2v Jo 



[°° dse~ s CP~\s)C(s - s) + PiP } )Tjj2 !°° dse- s CP- 
Jo 2v Jo 



\s)g(s)C(s-s) 



-qP- 1 ), (5.15) 

dse-"C p - 1 (s)g(s -s) + Z ^ Tjj2 f dse- s C p - 2 (s)g(s - s)£(s) 

2w Jo 
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PJ\ - 



pjp - \)Tjf< 
2v 



Pe- s CP- 2 ( S )G( S )(l- q ) 



(5.16) 



Now it is important to realize that the usual formulation of FDT does not hold in this case. Indeed, if the coupling 
constants fluctuate, then the heat current between the thermal baths cannot be neglected. In other words, the detailed 
balance condition is violated because there is a stationary current between the two heat baths, which changes its sign 
under time-reversal. Thus, we have a steady but non-Gibbsian state ||. Generally speaking, in such a state there 
does not exist any simple or even closed general relation between the correlation and response functions ||. However, 
such a relation is possible in some particular cases. It is interesting that in our case some generalized FDT exists, 
which is, however, non-universal in contrast to the usual one. Furthermore, we shall see that this theorem does not 
depend on secondary details of the model. As such it belongs to the thermodynamical picture of the glas sy state, 
together with the law for the change of heat ( 3.21 ) and non-equilibrium fluctuation relations |27| |2{|. Let us 
consider the generalized FDT in the form 



d s c{s) = f(-g( s ) + g{-s)) 

with some unknown coefficient T. After some calculations using d5~15| ), ( |5T6l ) we get 



T = T, 



(5.17) 



(5.18) 



It is customary to call this the modified FDT the "Fluctuation-Dissipation Relation" (FDR) or just the "modified 
FDT" . In the our two-temperature dynamics without detailed balance this is a very simple relation between the 
correlation function and the susceptibility. It is important that the form of the FDR does not depend on concrete 
characteristics of the model. 



We have obtained that the coefficient of FDR (it is Tj in the case of Eq. ( 5. IS ), and T in the case of (5__3)) depends 
crucially on the observation time: There is a direct correspondence between the time-scales which are considered 
and the proper temperature. Such phenomena were predicted recently for systems with "slow" dynamics p9| , |32| , ^3| . 
Particularly, such cons ider ations are a possible fundament for generalizing the notion of temperature. 

By the usual FDT (5J5) only an ergodic or short-time dynamics can be monitored fl|,p|,[22f . To take into account 
effects of RSB some regularization procedure is necessary. As was shown in [ p2[ for the n — p-spin spherical model 
the non-ergodic dynamics can be achieved by some other, "long-time" FDT 



d t C(t) 



T 



(-G(t) +<?(-*)), 



where m is the RSB parameter. In the section |fv| we discussed the analogy between the finite-n RS fr ee en ergy and 
the RSB free energy with q Q = 0. In the spirit of this analogy this long-time FDT corresponds to ( |5.18 ) because 
via the substitution m — ► n we go to this equation. This analogy is not an accident, of course. It displays a deep 
connection between systems with RSB and ones where different time-scales of relaxation and different temperatures 
are assumed initially. It seems to us that other interesting results can be obtained in this way in future. 
With help of the FDR we obtain the following formula for Q(Q): 



Q(S>) 



pq(l - q) 



(5.19) 



q - (p - 2)0Tj(l - q) 

Now the positivity of this quantity requires our old condition ( |4.15[ ). As we have seen, this condition is the necessary 
one for the validity of the RS assumption. Since G(s) decreases from Q{Q) to zero we have also the trivial consistency 
condition that the theory developed in the present subsection is nontrivial only for q > 0. 

Let us now discuss what happens in the limit t S> tj. We rewrite Eq. ( 5.1 5| ) taking into account (5.17, 5. IS), and 
the concrete value of r: 



(1 - q)(q p - 2 - e~ s C p - 2 {s))C{s) = T / dse"^" 1 (s)Q(s - s) 



If we want to investigate the static limit of this equation we should consider the large-s limit 

lim rj _ +00 (lim t ^ 00 C(t)) = lim C(s) = Q. 



(5.20) 



(5.21) 



In this case we have Q = 0, because in the relevant part of integral ( 5.20| ) the function Q is zero: When t/rj — * oo 
every correlation will vanish at large times, and the system goes into paramagnetic phase. It is just that statement 
which was predicted above starting from some heuristic arguments. 

There is no spin-glass phase if the spins and the coupling constants have nearly equal characteristic times. It is 
quite obvious in the light of the present discussion. 
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VI. SUMMARY 



This paper is devoted to a glassy system coupled to two heat b aths. In section II] we use the adiabatic assumption 
to generalize the usual thermodynamics. Its basic relation (3.17) involves the entropies of the spins and the coupling 
constants, which in the present approach have the independent and well-defined physical meaning. The developed 
theory has a general character, and does not depend on concrete details of the considered systems. After this, in 
section IV this theory is applied to the mean-field p-spin-interaction spherical model, extended to have correlated 
random bonds, expressed by a finite temperature Tj. In the limit Tj — > oo, so n = T/Tj — > 0, the usual spin-glass 
model with totally uncorrelated bonds is recovered. As noted recently J|(J, this type of correlations can make radical 
changes in the phase structure. In this context, the p-spin model is the convenient laboratory for investigating phase 
transitions, since it belongs to different universality classes for p > 2 and p — 2. Indeed, if n is large enough there are 
only first-order phase transitions with positive latent heat (see Figs. ^, ^). This is in the contrast to the first-order 
transitions without latent heat (p > 2) or the true second-order transitions (p = 2), which are more typical for spin 
glasses and glasses, and realized in the remaining parts of the phase diagram. The 1RSB (rep lica symmetry breaking) 
spin-glass phase can exist as a truly stable phase only for m < n < 1 (see Eqs. ( 4.30 , 4.31 )). Replica symmetry is 
always restored for sufficiently low temperatures and n > 0. Notice the differences compared to the SK model with 
infinite-order RSB, where a finite n mainly modifies the existing spin-glass phase, introducing the lower plateau for 
the order parameter q{x) []19| Jig ]. This plateau grows with n, and RSB disappears at some critical value n c (n c < 1). 
Nearly the same behavior is introduced by an external magnetic field. In our case such a phase does not exist at 
all, and the 1RSB phase with vanishing lower plateau exists even for n > 1, but only as a metastable phase. These 
distinctions are connected with different structures of the phase space. 

For all p > 2 the first-order phase transitions are related with an interesting effect: In spite of the fact that the 
jump of the mean energy u at the transition point is negative (because the latent heat is positive) the jump of the 
total entropy is positive. This uncommon property is possible only due to our generalized thermodynamical relation 
(3.17), combined with the fact that the corresponding jumps of s a and sj have opposite signs: As a < 0, As,/ > 0, 
but the sum s = Sj + s a has a positive jump (see Fig. ^|). The situation is slightly different for the first-order type 
phase transition without latent heat. In section IV B 1 we have seen that the total entropy increases continuously in 
the course of the phase transition from the paramagnet to 1RSB spin-glass (see Fig. p|). In this respect an interesting 
analogy exists with the process of coarse(fine)-graining (see the discussion after Eq. (3.13)). Further developments of 
these analogies will be quite interesting. 

There is a close relation between free energies and saddle-point equations of the finite n RS case and the qo = 
case of the 1RSB equations. The RS solution with nonzero n corresponds to the 1RSB solution with qo = Jl5| . 
This mechanism is responsible for the transition between the 1RSB and RS spin-glass phases. The transition is 
second-order with respect to free energy and its derivatives, but is connected with a jump of qo from zero to q\ that 
ensures replica-symmetric behavior (see Figs. |^, ^). This analogy exists in dynamics also: in our time-translation 
invariant two-temperature dynamics there is the phenomenon which is the analog of the generalized FDT in the 
n = non-equilibrium dynamics |3^| or longtime FDT in the corresponding non-ergodic dynamics P4I . Such an effect 
reflects intrinsic connections between systems where the complex structure of the phase space is self-generated and 
there arc different time-scales for the global relaxation (ergodicity breaking), and systems where different components 
have different temperatures and relaxation-scales. 

For n < 1 and p > 2 there is a difference between phase transitions predicted by adiabatic statics and adiabatic 
dynamics. This well known effect is due to the existence of the whole set of metastable states with free energies greater 
than the free energy of the pure states predicted by statics. It is connected with the absence of activated processes 
on the timescales considered in the dynamics |p5| , which enters due to mean-field (infinite dimension) character of 
the model |?5| . Namely, it is the opposed sequence of limits: In the true static consideration we observe times — > 00 
before the thermodynamic limit N — > 00, but if dynamics is investigated by means of generating functional p6| the 
first limit is taken after the second, which eliminates activated process that need time-scales exponential in N. In 
the corresponding finite-dimensional systems a smoothening of this effect is expected, where instead a sharp phase 
transition a near-critical domain of temperatures will take place. Notice also that for n = and p = 2 the RS 
spin-glass phase is only marginally stable. A non-zero n stabilizes the corresponding fluctuations. 

The predictions of the adiabatic statics and dynamics can be compared only for the relatively short observation 
times. The spin-glass phase appears at times <C tj (the characteristic time of the coupling constants), but disappears 
for the observation times ^> tj. In this limit of long observations the coupling constants cannot be viewed as frozen. 
This is the non-equilibrium steady state without any spin-glass ordering (only a critical slowing down of the spin-spin 
correlation function occurs when Tj — > 0). In this respect it is similar to weak ergodicity breaking occurring in the 
non-equilibrium dynamics | ^2| . A generalized fluctuation-dissipation relation has been proven, which contains the 
temperature of the couplings instead of the temperature of the spins. This relation is also closely connected to the 
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non-equilibrium generalization of the FDT [ [32|j33| , where the asymptotic long-time non-equilibrium state of the n — 
p-spin spherical model is considered. 
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APPENDIX A 



In this appendix we consider h ow to ge t the usual Langevin equations of the spin-glass model with a priori random 
freezed cou pling constants from (2.2, 2.3). 

Eq. (2.3) can be solved exactly with respect of J.£ 1 ...j : 



Jn...i P (t) = 4° ) .. <p e- (t_to)/rj +A il ... ip (t) + B h .. Ap (t) 



J Jt 



(A.l) 
(A.2) 



B n ...i p (t) = 1- f dte-^l^' J N a n (t)...a lp (t), 

1 J Jt 



(A.3) 



where J±p i are the initial conditions at the moment t — to, tj — Tjjfj/v, and Jjy = p\J 2 /2N p 1 . The initial factors 
can be neglected if to >— > — oo, \t \ 3> tj. Further we have 



{A ix .. Ap (t)A h . .,(*')) = 



Ti3- X . . - p -\t-t'\/rj 



(A.4) 



Thus if tj 3> t — t', then Ai t .. A is a quenched Gaussian noise, and if v ~ Tj and Tj \— > oo then can be 

neglected with respect of Ai 1 .,.i . So in these limits is a quenched Gaussian noise. Each coupling constant is 

independent of the other ones and the spins. 



APPENDIX B 



In this appendix we discuss the derivation of (2.4) from the initial Langevin equations. We investigate these 
equations by the dynamical generating functional method |3q] El]]. 



i=z dyn =|n^ n ^••v^p(-^E/^ 2 w-4r^ e / 

i [»i.-.*p] \ 1 ' [ii—i p ] 



dtr)l.. Ap {t) , 



(B.l) 



where [ii . . . i p ] = 1 < i% < . . . < i p < N, and normalization factors are included in Drji, Dr]i 1 „ A . By means of Zd yn 
we can compute the noise average of any quantity A({cr}, {J}): 



j DoDJ 


5i~i 




5rj 









A({a}, {J}) exp[-^ Y,J dt ( Td ^ + W * + 



AT 



an 



[ii—ip] 



dJi\...i v 



(B.2) 



where [drj/da], [Srj/SJ] are the corresponding functional Jacobians. After a simple transformation we have 
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Z dyn = J DaDJDaDJ exp ^-rT^] J dtaf J dta^t) (vd t ai + ra t + j 



exp J2 

•••»*.] 

exp(V v<7 + V n j) 



TjTj / dtJ^ty+i / dtJ ll .., lp {t)[Tjd t J tl ... lp + 



dJ,-, 



(B.3) 



Here the last exponent is the contribution of the functional Jacobians; we shall not write this expression explicitly 
because it is not relevant in the mean-held approximation. 

We want to derive equations for spin dependent functions, therefore in eq. (B.l) we can take Gaussian integrations 
by {J}, {J}. The result is 

Z dyn = J DaDaexp[-TTY^ J dt&i(t) + J dta l (t)(Td t + r)a t 

i i 

^ J dtdt'4>(t - t')a il ... ip (<T,a,t')b il ,. Ap (a,t) 

[i 1 ...i p ] 

— X! dtdt'k(t - t / )a il ... ip (<j,d-,t / )a il ... ip (<j,a,t)} 



?' J 2 
Tj 



T,J 2 



exp(V n „ + V v j) 



(B.4) 



where 



(B.5) 



<£(i - t') = 0(f - t')e- (t ~*' )/rj , fc(f - f') = e-l*-*'!/^, TJ = Tj/w (B.6) 

By the standard mean-field procedure [ fllf we introduce the following order parameters: 

Qi (*,*') = (ia(t)ia{t')), 
Q 2 {t,t') = {a{t)a{t')), 
Qz{t,t') = (<j{t)icr{t')) : 

Q 4 {t,t') = (<T(t')icr{t)}, (B.7) 

and the corresponding Lagrange factors X s (t,t'), s = 1, ..,4. In this scheme Q2 is the correlation function, Q3, Q4 are 
the susceptibilities; Q\ ("field-field" correlation function) should be taken zero by reasons of causality [pTlf| . Now we 
have 

4 nA nin / 



where 



^dy„ = / I! DX 2^ QS CXP ( JVn ( A -» Q-) + ^ / 

Q{X S ,Q S ) = - J dtdt'J2\ s (t,t')Q s (t,t r ) + ^- J dtdt'^t-t^MQ^ 1 (t,t') 

+ V ^r~ I dtdt l ^{t-t')[Q 1 {t : t l )Ql-\t 1 t') + ( P -l)Q 3 {t 1 t l )QS,t')Qr 2 (t 1 t% (B.8) 



C(a,a) = -TTJ2 J dta^t) - ij^ J dtai(t){Td t + r)a t 

i i 

+Ai(t, t')ia(t)ia(t') + X 2 (t, t')a(t)a(t') 

+A 3 (t, t')ia(t)a(t') + X 4 (t, t')ia{t)a{t') (B.9) 



2G 



By variational methods we obtain 



X 1 (t,t') = ^^k(t-t')Q p 2 - 1 (t,t') 



2r, 

fc(t - 0((P - W'C*. + (P - 1)(P - 2)Q a (t, f f)Q§~ 8 (t, 0) 



21 j 4v 
A 4 (t, = (p - l)^^-k(t - OOaC*, 005" 2 (*» 0, 



(B.10) 



A2 can be adsorbed in the Jacobians. These results should be substituted to (B.9): the effective dynamics of a spin 
is determined by spins motion at the environment of the spin, and by motion of the coupling constants. After this 
lengthy calculation we arrive at (2.4). 
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